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PREFACE 


[/The  Information,  Presentation,  and  Controls  Group 
(AAAT-1)  of  the  Air  Force  Avionics  Laboratory  is  interested 
in  determining  the  human  engineering  problems  that  may  be 
encountered  by  those  using  a  display  with  a  constantly 
changing  background  such  as  the  Airborne  Electronic  Terrain 
Mapping  System  (AETMS).  This  research  was  conducted  to 
enhance  the  AETMS  be  adding  a  symbol  producing  software 
overlay  and  to  develop  the  basis  for  a  symbol  set  for  the 


AETMS. 
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ABSTRACT 


This  report  has  its  basis  in  the  Airborne  Electronic 
Terrain  Happing  System  (AETMS),  an  aircraft  mapping  system 
based  on  an  idea  proposed  by  L.A.  Tamburino  and  developed  by 
the  Air  Force  Avionics  Laboratory. 

A  constantly  changing  background  provides  the  basis  for 
an  interesting  investigation  on  the  hypothesis  that  a 
dynamic  background  will  distract  the  operator's  attention 
away  from  important  details  on  the  display. 

The  software  developed  provides  an  overlay  of  symbols 
onto  the  terrain  map  generated  by  the  AETMS  and  is  contained 
in  this  report.  A  symbol  and  color  set  is  suggested  for  the 
AETMS. 

An  experiment  to  determine  a  master  symbol  and  color 
set  is  suggested.  The  experiment  suggests  using  both  simple 
vector  symbols  and  Fourier  transformed  symbols  to  help 
define  the  master  set. 
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An  Evaluation  of  Detail  in  Dynamic  Visual  Displays 

Lx  INTRODUCTION 

This  thesis  has  two  main  objectives.  One  objective  is 
to  provide  a  software  package  that  will  overlay  symbols  onto 
a  terrain  map  generated  by  the  Airborne  Electronic  Terrain 
Mapping  System  (AETMS).  This  system  was  developed  by  the 
Information,  Presentation,  and  Controls  Group  (AAAT-1)  of 
the  Air  Force  Avionics  Laboratory,  based  on  an  idea  proposed 
by  L.A.  Tamburino  (Ref  16).  The  software  package  will 
provide  a  video  image  processor  the  ability  to  display 
symbols  as  well  as  terrain.  The  second  objective  is  to 
experiment  with  a  small  set  of  symbols  to  find  shapes  and 
colors  that  are  easy  to  identify. 

The  hardware  basis  for  this  thesis  is  the  AETMS.  This 
system  is  designed  to  aid  pilots  in  low  alitude  flying. 
"The  AETMS  is  more  than  a  horizonital  or  vertical  situation 
map  system.  It  is  an  integrated  information  system  that 
will  supplement  current  aircraft  systems,  giving  the  pilot 
the  capability  to  negotiate  low  level,  high  speed  profiles" 
(Ref  4:10).  Designers  have  constructed  software  and 
hardware  that  converts  a  digitized  representation  of  terrain 
into  visual  display.  The  software  developed  for  this  thesis 
provides  an  overlay  of  a  symbol  onto  the  terrain  at  the 
appropriate  latitude  and  longitude. 

There  have  been  many  studies  of  symbols  and  displays  in 
the  past.  These  studies  were  mainly  concerned  with  displays 
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that  had  non-dynamic  or  static  backgrounds,  i.e., 
backgrounds  that  do  not  change.  The  AETMS  display  changes 
as  does  the  vehicle's  position.  A  constantly  changing 
display  presents  some  interesting  questions: 

1.  Will  the  dynamic  background  distract  the  operator's 
attention  away  from  important  details,  such  as  an 
approaching  target? 

2.  If  distraction  may  occur,  then  what  is  the  best 
attention  getting  shape  and/or  color  for  a  symbol? 

/ 

3.  What  background  color  should  be  combined  with  a 
symbol's  shape  and  color?  These  questions  are  the 
theoritical  basis  for  the  thesis. 

Due  to  system  limitations,  it  was  impossible  to 
integrate  the  thesis  software  with  the  AETMS.  The  reasons 
for  this  were  twofold.  First,  the  system  allows  only  28K  of 
memory  to  be  allocated  to  a  task.  The  thesis  software  alone 
took  over  28K  and  finally  had  to  be  tasked  in  three  separate 
packages  so  that  it  could  be  tested  by  itself.  Presently, 
the  thesis  software  can  generate  symbols  on  a  plain 
background.  The  thesis  can  be  re-written  to  be  overlayed 
onto  itself.  This  method  will  allow  the  thesis  software  to 
be  tasked  with  the  AETMS.  Secondly,  the  AETMS  is  a  poorly 
documented  system.  The  system  exits  upon  encountering  an 
error.  Explanations  as  to  why  an  exit  occurred  are  not 
generated  by  the  system.  This  makes  trouble  shooting  rather 
difficult.  This  system  is  now  being  updated  to  include 
error  statements. 
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These  limitations  made  it  impossible  to  complete  the 
experiments  associated  with  determining  optimum  symbol  shape 
and  color.  Therefore,  an  explanation  of  the  experiment  is 
included,  along  with  an  analysis  of  symbols  and  color,  a 
discussion  of  software,  and  a  literature  review. 
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II.  SOFTWARE 


The  Airborne  Electronic  Terrain  Mapping  System  (AETMS) 
can  be  simply  described  in  the  following  manner:  "The 
Digital  recordings  of  the  Defense  Mapping  Agency  (DMA)  world 
wide  data  base  are  preprocessed  as  depicted  to  obtain 
polynomial  fits  for  the  terrain  elevations  (Figure  1). 
These  polynomials  are  stored  as  sequences  of  coefficients 
(i.e.,  compressed  form).  The  on-board  mass  memory  of  the 
AETMS  will  be  loaded  from  a  world  wide  base.  The  aircraft 
naviagation  system  would  provide  present  position  inputs  to 
the  on-board  computer  which  uses  them  to  access  memory.  The 
retrieve  coefficients  would  be  used  to  generate  a  terrain 
relief  display  for  the  pilot/navigator"  (Ref  10:8). 

The  AETMS  is  currently  being  tested  on  a  PDP  11/45. 
The  information  generated  by  the  AETMS  is  displayed  on  a 
Ramtek  display  system  via  a  device  driver  written  by  SRL, 
Inc.  The  original  AETMS  was  written  by  the  Systran 
Corporation  of  Dayton,  Ohio.  The  AAAT-1  group  is  presently 
re-writting  the  AETMS  software  so  that  is  easier  to  use  and 
more  responsive  to  the  user.  Figure  2  shows  the  system 
configuration . 

The  AETMS  consists  of  two  software  packages,  PRSPCT  and 
CNTOUR.  PRSPCT  provides  the  user  with  a  direct  heads  up 
view  of  the  terrain  as  seen  from  the  cockpit.  CNTOUR 
provides  a  display  much  like  that  seen  on  a  topographical 
map.  Both  PRSPCT  and  CNTOUR  are  interactive  systems, 


4 


t  ion 


accepting  input  from  a  joystick  The  interested  reader  is 
referred  to  Systran  documentation  for  a  more  detailed 

discussion  of  PRSPCT  and  CNTOUR  (Ref  15). 

AETMS  designers  use  the  following  two  terms  in  their 
definition  of  the  AETMS  structure.  They  are  referenced  in 
this  description  of  software  and  so  their  definitions  are 
included  here.  A  patch  is  defined  as  follows:  "Terrain  is 
divided  into  a  number  of  patches.  A  patch  is  a  small  area 
of  terrain  whose  altitude  at  each  point  can  be  determined 
from  a  polynomial.  The  polynomial  is: 

Z  =  C1+C2X+(C3+C4X)Y 

where  X,Y  are  the  coefficients  of  the  point  and  Cl,  C2,  C3, 
C4  are  four  coefficients  that  vary  from  patch  to  patch,  and 
Z  is  the  altitude  of  the  terrain  at  X,Y  (Ref  4:15). 

Terrain  data  (coefficients)  from  the  DMA  data  base  is 
stored  on  a  disk.  These  concepts  are  described  in  detail  by 
Tamburino  (Ref  16). 

Another  important  concept  is  that  of  a  BAU.  BAU  is  an 
ancronymn  for  Binary  Angular  Unit  and  equals  PI/128.  This 
is  a  constant  used  to  convert  azimuth  into  smaller  units  so 
that  it  is  easier  to  access  the  data  base. 

The  thesis  software  consists  of  modules  that  determine 
window  bounds,  check  data  against  the  bounds,  and  draw 
symbols  over  the  terrain  generated  by  the  AETMS.  The  entire 
thesis  module  is  titled  SYMBOL.  The  PRSPCT  executive 
routine  call  SYMBOL.  Figure  3  gives  a  pictorial  view  of  the 
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hierarchy  of  the  modules  in  SYMBOL.  Figure  4  gives  a 
representation  of  the  relationship  between  sub-modules  in 
SYMBOL  and  the  defined  common  areas.  Appendix  A  contains  a 
flowchart  for  the  module,  and  a  listing  of  SYMBOL  and  test 
results  are  presented  in  Appendix  G. 

SYMBOL  has  five  main  functions: 

1.  Determine  the  values  of  the  corners  of  the  window, 
aircraft  heading,  and  conversion  factors. 

2.  Call  CONVRT  each  time  the  aircraft's  position 
changes . 

3.  Call  CHECK1  with  the  bounds  found  (//I  above),  if 
and  only  if  aircraft  heading  is  North  (0  or  360),  South 
(180),  East  (270),  or  West  (90). 

4.  Call  CHECK2  if  and  only  if  aircraft  heading  is 
anything  other  than  North,  South,  East,  or  West. 

5.  Call  FLAG  if  and  only  if  there  are  symbols  within 
the  bounds  of  the  window. 

PRSPCT  passes  11  arguments  to  SYMBOL.  Table  I  presents 
the  argruments  and  a  short  definition  for  each. 

SYMBOL  uses  these  arguments  to  determine  the  corner 
values  ( A , B , C , D ) ,  conversion  factors  (P0SY,P0SX),  and 
aircraft  heading  (IHEAD).  Appendix  C  contains  the  equations 
for  generating  the  needed  information.  Appendix  B  contains 
the  variablee  and  table  definitions  for  SYMBOL  and  PRSPCT. 
SYMBOL  returns  nothing  to  PRSPCT. 

Subroutine  CONVRT  is  the  first  subroutine  called  by  the 
main  body  of  SYMBOL.  P0SX  and  POSY,  the  conversion  factors, 
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TABLE  I 
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j  ARGUMENT 

DEFINITION 

'  IAY 

Latitude  (degrees) 

FAY 

Latitude  (minutes) 

IAX 

Longitude  (degrees) 

FAX 

Longitude  (minutes) 

DX/DY 

Patch’s  angular 
width/length  (degrees) 

NX/ NY 

Number  of  Patches  in 
memory 

A 

Aircraft  azimuth  in  BAU ' s 

f 

1  D 

i 

Aircraft  speed  (knots) 

I  DA 

Aircraft  change  in  azimuth 
in  BAU’s 

are  passed  to  CONVRT  from  SYMBOL.  CONVRT  uses  BLOCK  DATA 
via  the  common  area,  DTABLE.  BLOCK  DATA  contains  real  world 
latitude  and  longitude  in  a  table  known  as  POSTAB.  POSTAB 
also  holds  the  flag  of  an  object  associated  with  a 
particular  longitude  and  latitude.  The  dimension  of  POSTAB 
is  (x,3),  where  the  x  indicates  that  POSTAB  may  contain  as 
many  symbols  as  may  be  encountered  in  a  particular  flight. 

The  main  function  of  CONVRT  is  to  convert  POSTAB  to 
display  (patch)  coordinates.  This  is  accomplished  by  adding 
POSY  to  the  latitude  values,  and  POSX  to  the  longitude 
values.  The  new  values  are  then  placed  in  SYMTAB,  dimension 
(x,3),  and  returned  to  SYMBOL  via  the  common  area  DBLOCK. 

Subroutine  CHECK1  is  called  if  aircraft  heading  is 
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North  (0  or  360),  South  080),  East  (270),  or  West  (90). 
The  window  coordinates  are  first  sorted  into  minimum  and 
maximum  values  and  then  passed  to  CHECK1.  If  the  SYMTAB 
values  fall  within  the  bounds,  then  it  is  placed  in  RAMTAB. 
RAMTAB  is  later  used  in  FLAG  to  tell  the  object  drawing 
routines  what  and  where  to  draw  a  symbol. 

Subroutine  CHECK2  is  called  if  aircraft  heading  is 
anything  other  North,  South,  East,  or  West.  If  so,  then  it 
is  known  that  the  window  is  rotated  as  in  figure  5. 
Checking  for  symbols  is  more  complex  in  CHECK2  than  in 
CHECK1.  Figure  6  gives  a  pictorial  description  of  the 
discussion  to  follow. 

First  an  initial  check  is  done  against  maximum  and 
minimum  values  to  see  if  the  symbol  is  with  in  the  larger 
square,  IJKL.  Those  values  that  are  within  these  bounds  are 
placed  in  a  temporary  table,  TEMTAB.  Next,  the  symbols  that 
are  within  the  triangles,  (eg.  123),  must  be  eliminated  as 
they  are  not  in  the  display.  Midpoints  and  the  slopes  of 
the  rotated  display  edges  are  used  to  do  thisis  checking. 
Figure  7  shows  these  points.  Line  slopes  for  lines  AB,  BC, 
CD,  and  AD  are  computed.  The  midpoints  are  necessary  to 
determine  which  triangle  the  point  is  in.  This  is  important 
since  the  next  step  involves  a  line  slope  comparison. 

Suppose  point  x,y  (figure  7)  is  a  point  that  may  or  may 
not  be  in  the  display  bounds.  CHECK2  does  the  following: 

1.  Calculates  which  triangle  x,y  is  in. 

2.  Calculates  the  slope  of  line  Bx,y. 


3.  Slope  of  line  BC  has  already  been  determined  and  is 


constant  for  the  present  aircraft  heading. 

4.  Compares  the  slope  of  line  Bx,y  with  that  of  line 
BC.  If  the  slope  of  Bx,y  is  less  than  that  of  BC,  then  x,y 
is  not  transferred  to  RAMTAB.  Consideration  of  another 
point,  x2,y2,  is  the  same  except  in  line  slope  comparisoon. 
If  the  slope  of  Cx2,y2  is  greater  than  that  of  line  DC,  then 
x2,  2  is  not  in  the  display.  This  is  why  determining  which 
triangle  the  point  is  in  is  important. 

Both  CHECK1  and  CHECK2  return  a  variable,  LCOUNT,  and  a 
table*  RAMTAB,  to  SYMBOL  via  the  common  area  DBLOCK.  LCOUNT 
is  the  number  of  symbols  that  are  in  RAMTAB  and  hence  are 
within  the  display  bounds.  This  is  important  in  the 
execution  of  other  subroutines. 

Subroutine  FLAG  is  the  last  routine  called  by  SYMBOL. 
SYMBOL  passes  RAMTAB  and  LCOUNT  to  FLAG. 

FLAG  checks  the  value  of  the  x,3  entry  in  RAMTAB.  The 
value  in  x,3  determines  which  symbol  must  be  drawn  at  a 
particular  latitude  and  longitude. 

Each  object  has  a  separate  subroutine  to  output  a 
representative  of  that  object.  FLAG  does  not  return  any 
values  to  SYMBOL.  FLAG  also  sets  a  reset  value,  IFLAG,  for 
use  by  the  Ramtek  display  driver.  Reset,  or  erasure,  occurs 
only  when  a  new  table  of  RAMTAB  values  is  passed  to  FLAG. 
After  erasure,  IFLAG  is  set  to  zero  so  that  further  erasures 
will  be  suppressed  until  FLAG  is  again  called  by  SYMBOL. 

The  object  drawing  routines  referred  to  above  are 
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simple  end  point  plotting  routines.  FLAG  passes  IFLAG, 
RAMTAB,  and  a  RAMTAB  position  pointer,  to  these  routines. 

RAMTAB  latitude  and  longitude  must  be  scaled  to  fit 
onto  the  video  screen.  Therefore,  it  is  necessary  to  first 
call  subroutine  OFST. 

RAMTAB  and  J  are  passed  to  OFST.  OFST  establishes  the 
symbols  position  on  the  screen  by  converting  its  position  in 
the  window  to  the  same  relative  position  on  the  screen. 
Screen  size  is  480  (x)  by  640  (y),  with  the  origin  n  the 
upper  left  hand  corner.  A  re-scaled  RAMTAB  value  is 
returned  to  the  calling  routine. 

Final  output  of  a  symbol  occurs  when  the  object  drawing 
routine  calls  subroutine  DRAW.  This  subroutine  is  a 
slightly  modified  version  of  a  vector  drawing  routine 
designed  and  implemented  by  Dale  Rangeler  of  SRL,  Inc. 

Dp\W  utilizes  the  Ramtek  graphic  display  driver  to 
output  vectors.  Each  drawing  routine  passes  a  4X4  matrix 
and  IFLAG  to  draw.  DRAW  simply  writes  a  line  between  the 
beginning  x  and  y  coordinates  and  the  ending  x  and  y  coor 
dinates.  The  number  of  calls  to  DRAW  by  a  particular  object 
drawing  routine  is  a  function  of  the  number  of  vectors  that 
an  object  is  composed  of. 

The  program  to  output  Fourier  transforms  of  symbols  is 
essentially  the  same  except  for  the  addition  of  three 
subroutines . 


Subroutine  FOURT  is  a  program  by  Norman  Brenner  from 
the  basic  program  by  Charles  Rader.  It  uses  the  Cooley- 


Tukey  Fast  Fourier  Transform  and  is  written  in  USASI  basic 
fortran  (Ref  4).  This  subroutine  is  called  by  the  drawing 
routines  to  determine  the  fast  Fourier  transform  data  points 
of  the  object  in  question. 

Subroutine  ZERO  zeroes  out  data  after  the  third 
harmonic  of  Fourier  data.  This  is  necessary  to  get  a  usable 
representation  of  the  object  from  the  data. 

Subroutine  SCALE  reduces  the  data  points  to  a  size  that 
is  compatible  to  the  Ramtek  display  dimensions. 

Testing  SYMBOL  consists  of  checking  values  on  the 
bounds  and  corners,  as  well  as  values  in  between  the  bounds. 
Appendix  F  contains  a  SYMBOL  user  guide.  Appendix  G 
contains  a  program  listing  and  test  values. 
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III. 


REVIEW 


This  chapter  has  a  twofold  purpose.  The  first 
objective  is  to  present  some  ideas  about  contemporary  map 
displays  and  information  requirements,  and  to  show  that  the 
AETMS  is  a  versatile  system  that  does  infact,  fulfill  these 
information  requirements. 

The  second  objective  is  to  put  forth  some  ideas  about 
research  that  has  been  done  concerning  symbols,  their  size 
and  color,  and  to  give  a  short  synopsis  of  other  problems 
that  are  associated  with  visual  displays. 

Human  factors  engineering  evaluation  has  become  an 

\ 

important  pre-design  consideration.  This  is  necessary 
because  a  tool  that  is  designed  for  human  use  reduces 
mistakes  and  frustration.  In  light  of  this,  the  AAAT-1 
Group  tasked  the  Aerospace  Medical  Research  Laboratory 
(AMRL)  to  do  an  exhaustive  search  of  literature  on  current 
map  systems.  AMRL  found  that  there  are  six  map  systems  in 
existence  today.  The  following  summary  of  map  types 
describes  each  map  and  its  major  limitations,  and  is 
described  in  more  detail  in  a  report  prepared  for  the  AAAT-1 
Group  by  AMRL  (Ref  10). 

The  most  primitive  map  is  a  handheld  chart.  It  has  the 
obvious  disadvantage  of  being  nearly  impossible  to  use  while 
flying  at  high  speeds  and  low  altitudes.  Currently,  no 
fighter  system  uses  hand  held  charts  as  a  map  system. 

Direct  view  maps  are  paper  maps  mounted  between 
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rollers.  The  map  moves  as  does  the  airplane.  Movement  is  a 
result  of  computer  or  doppler  input.  The  major  disadvantage 
of  this  system  is  that  it  is  difficult  to  imput  steering  or 
heading  changes  into  the  system. 

The  projected  map  system  uses  a  rear-project 
microfilmed  transparency  of  the  original  map.  It  is  limited 
because  it  is  costly  and  cannot  be  changed  for  a  specific 
flight . 

A  combined  map/CRT  is  a  system  that  displays  a  map  on  a 
CRT.  Researchers  have  found  that  there  are  legibility 
problems  with  this  system. 

Electronic  displays  generate  all  information 
electronically.  Currently,  there  are  no  systems  with 
airborne  capablities  for  using  an  electronic  system. 
Designers  are  hesitant  to  use  this  type  of  a  system  because 
it  is  easily  detectable  by  enemy  radar. 

Terrain  avoidance  and  terrain  following  (T/A,  T/F) 
systems  allow  pilots  the  ability  to  hide  their  aircraft 
under  conventional  electronic  det  on  systems  by  allowing 
them  to  hug  the  terrain.  The  AETMS  is  a  system  designed  to 
be  a  T/F  system.  "The  AETMS  is  more  than  just  a  horizonital 
or  vertical  situation  map  system.  It  is  an  integrated 
information  system  that  will  supplement  current  aircraft 
systems,  giving  the  pilot  the  capability  to  negotiate  low 
level,  high  speed  profiles"  (Ref  50:10). 

Information  parameters  for  future  aircraft  systems  are 
demanding.  They  were  described  by  Crawford  (Ref  1)  and  are 
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V 


TV 


listed  below: 


1.  Altitude  below  500  ft. 

2.  Speeds  proportionate  with  pilot  and  aircraft 
capabilities . 

3.  Sensing  equipment  that  is  'invisible',  i.e.,  not 
seen  by  enemy  radar. 

4.  Use  of  missiles  which  require  accurate  positioning. 

5.  Minimizing  detection  time  by  maximizing  time 
'under'  radar. 

The  AETMS  was  designed  to  provide  answers  to  all  of 
these  parameters.  The  pilot  will  be  able  to  fly  below  500  ft 
at  his  maximum  speed.  It  is  an  internal  system  and  hence, 
it  does  not  leave  a  signature  that  can  be  read  by  enemy 
detection  systems.  It  is  a  highly  accurate  system  since  it 
is  an  exact  copy  of  digitized  terrain  data.  The  pilot  can 
stay  below  radar  until  just  before  weapons  delivery.  This 
is  because  he  will  not  need  to  manually  search  for  targets. 
Target  points  will  be  displayed  on  the  screen.  The  system 
has  the  advantage  of  providing  a  look  ahead  feature  for  the  • 
pilot.  Look  ahead  gives  the  pilot  time  to  plan  at  alternate 
routes  or  targets.  It  is  obvious  that  this  system  can 
reduce  pilot  stress,  and  therefore,  will  help  prevent  errors 
from  fatigue. 

"The  Joint  Tatical  Information  Display  Syatem  (JTIDS) 
is  a  digital,  secure,  j am- r e s i s tan t ,  communication  system 
for  a  real-time  command  and  control  of  combat  operations" 
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(Ref  1:2).  JTIDS  monitors  have  the  responsibility  for 
standardization  of  a  symbol  set  for  aircraft  systems.  This 
is  necessary  be  -■  se  contractors  develop  a  set  of  symbols 
each  time  they  bring  a  new  aircraft  system  on-line.  A 
Symbology  Standardization  Committee  (SSC)  was  formed  to 
develop  the  standards.  The  SSC  made  several 
recommendations,  a  few  of  which  are  important  to  this 
discussion.  A  more  detailed  explanation  of  the  JTIDS,  SSC, 
and  its  recommendations  can  be  found  in  a  report  prepared  by 
the  SSC  (Ref  2). 

The  important  recommendations  are: 

1.  Largest  dimension  of  a  symbol  should  not  be  greater 

than  17  minutes  of  visual  angle. 

2.  The  symbol  height  to  width  ratio  should  be  3:2  (Ref 

2)  . 

Past  experiments  have  shown  that  17  minutes  of  arc  is 
optimum.  The  following  equation  is  used  to  calculate  the 
size  of  a  character: 


H=2DTAN( 9/2*60) 

D=  viewing  distance  in  inches  from  eye  to  surface 
9=  minutes  of  visual  angle  (arc) 

H=  symbol  height  in  inches  (Ref  2) 

A  study  by  the  McDonnell  Aircraft  Company  (McAir) 
presents  a  definition  of  a  test  JTIDS  symbol  set  in  the  F  —  1 5 
system.  They  established  the  same  basic  principles  on 
object  size  as  did  the  SSC.  In  addition,  they  determined 
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that  color  is  an  excellent  tool  to  use  in  preventing  display 
clutter.  Clutter  is  a  result  of  trying  to  place  too  much 
information  on  a  display.  The  operator  becomes  overloaded 
with  informtion  and  therefore,  may  miss  important  points. 
McAir  used  the  standard  three  color  system:  red  indicates 
hostility  or  danger,  green  represents  friendliness  or 
safety,  and  yellow  indicates  an  unknown  situation  (Ref  12). 

Electronic  display  systems  also  present  other 
complications  in  developing  an  optimum  visual  display. 
These  problems  include  flash  or  flicker,  excess  brightness, 
ambient  light,  and  the  adaptation  differences  required  for 
night  vision. 

Flash  or  flicker  is  a  phenomenon  typical  of  electronic 
displays.  The  image  on  the  screen  appears  to  flicker.  This 
is  especially  noticeable  in  a  dark  environment.  It 
increases  fatigue  and  eye  strain.  Flicker  can  be  minimized 
by  reducing  contrast  and  background  brightness. 

Excess  brightness  is  another  problem  associated  with 
electronic  displays.  Either  a  symbol  or  its  background  is 
too  bright.  Both  of  these  possibilities  increase  the  chance 
that  other  elements  of  the  display  will  be  hard  to 
distinguish.  This  problem  also  causes  fatigue  and  eye 
strain . 

Ambient  light  is  the  light  that  surrounds  the  display. 
It  changes  some  of  the  other  parameters  that  must  be 
considered  in  developing  good  displays.  It  may  decrease 
contrast  or  foreground  brightness  depending  on  its 
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intensity.  These  changes  may  in  turn  increase  the  chance  of 
eye  strain  or  fatigue. 

The  adaptation  requirement  necessary  for  a  change  from 
day  to  night  vision  must  be  considered  when  designing  a 
visual  display  system.  It  is  more  difficult  to  see  at 
night.  Looking  out  into  the  dark  and  then  down  into  a 
lighted  screen  causes  immediate  adaptation  problems.  This 
is  probably  the  hardest  problem  to  solve  or  minimize,  and 
can  potentially  be  one  of  the  most  dangerous  dilemmas  that  a 
pilot  may  face. 

The  preceding  discussion  was  a  summary  of  a  few  of  the 
problems  that  others  have  observed  and  have  tried  to  solve. 
This  thesis  does  not  consider  any  of  these  problems,  but  the 
experiment  was  designed  with  them  in  mind.  A  detailed 
description  of  these  problems  and  their  solutions  can  be 
found  in  a  work  by  Ketchel  and  Jenney  (Ref  8)  and  Soliday 
(Ref  14). 


IV.  SIHBGL  Aim  COLOR  SET 


This  chapter  will  give  some  insight  as  to  why  a  set  of 
symbols  and  colors  were  chosen  for  the  experiment. 

The  object  set  for  this  experiment  consists  of  eight 
symbols  and  their  Fourier  transforms  (FFT).  Appendix  D 
contains  a  pictorial  representation  of  the  symbols  as  they 
are  seen  on  the  Ramtek  display. 

The  objects  in  the  symbol  set  represent  cultural  and 
linear  objects,  and  come  from  three  categories.  These 
catagories  include  obstructions,  targets,  and  linear 
objects.  Table  II  shows  the  categories  and  objects. 

The  obstruction  set  is  mandatory  since  the  AETMS  is 
designed  to  be  used  in  aircraft  flying  at  low  altitude  and 
high  speed.  The  pilot  needs  to  be  pre-warned  of  any 
upcoming  obstructions  in  order  to  avoid  them. 

Landmarks  and  target  categories  are  necessary  for 
similar  reasons.  The  pilot  needs  a  look  ahead  capability  in 
order  to  prepare  for  weapons  delivery  or  a  change  in  course. 

Linear  objects  will  be  most  difficult  to  manually 
identify,  because  of  high  speed  and  a  perspective 
background.  Hence,  linear  objects  are  included  in  the 
symbol  set. 

Kabrisky  hypothesized  that  a  two  dimensional  Fourier 
transform  occurs  on  visual  input,  and  that  this  data  is  used 
by  the  human  visual  system  for  rocessing  (Ref  7). 
Therefore,  the  Fourier  transforms  are  included  in  the  set  so 


TABLE  II 


C -  ... 

CATEGORY 

OBJECT  | 

Obstructions 

Bridge 

( Landmarks) 

Tall  Building 

Electrical  Wires 

Targets 

Target  Designator 

Pointer 

Linear 

Landing  Strip 

(Landmarks) 

• 

_ 

Highway 

that  it  can  be  determined  through  testing  whether  a  simple 
representation  of  a  object  or  its  FFT  is  easier  to  identify. 
Adding  FFT's  to  this  thesis  is  for  testing  purposes  only, 
the  final  symbol  set  will  not  include  FFT's. 

Color  is  a  tool  that  can  help  enhance  the  usefulness  of 
any  display.  Color  sparks  curiosity.  A  color  coded  system 
can  also  help  eliminate  clutter.  It  is  important  to  find 
the  best  combination  of  colors  for  the  AETMS.  Best  can  be 
described  as  any  number  of  things,  including  appeal, 
functionality,  and  legibility. 

Red,  green,  and  yellow  are  traditional  aircraft 
instrumentation  colors.  Red  indicates  hostility  or  danger, 
green  shows  friendliness  or  safety,  and  yellow  symbolizes  an 
unknown  condition.  Table  III  shows  foreground  and 
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TABLE  III 


I 

SYMBOL 

COLOR 

BACKGROUND 

COLOR 

SIGNIFICANCE 

;  Red 

Grey 

Hostile 

Green 

Grey 

Friendly 

■  Yellow 

Grey 

Unknown 

Grey 

Red 

Hostile 

1  Grey 

Green 

Friendly 

i  Grey 

Yellow 

Unknown 

i 

White 

Black 

Friendly 

Black 

White 

Hostile 

background  color  combinations. 


Determining  a 
will  help  make  the 
pilots. 


good  combination  of  colors  and  symbols 
AETMS  a  versatile  and  functional  aid  to 
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V.  METHODOLOGY 


This  chapter  reviews  how  the  experiment  was  to  be 
conducted,  and  explains  what  video  output  is  necessary  for 
such  an  experiment.  The  AAAT-1  Group  has  the  equipment 
necessary  to  make  a  video  recording  of  output  produced  by 
the  AETMS  and  SYMBOL.  It  is  possible  therefore,  to  produce 
a  sequence  of  AETMS  and  symbol  overlay  outputs  that  can  be 
used  in  an  experiment. 

The  output  should  consist  of  three  separate  tasks:  the 
learning  task,  a  non-stress  identification  task,  and  a 
stress  producing  validation  task. 

Task  1,  the  learning  task,  is  necessary  because  past 
results  have  shown  that  subjects  involved  in  tests  such  as 
this,  need  to  learn  about  the  task  before  they  can  perform 
it  accurately  (Ref  3)-  If  this  segment  is  ignored,  then  the 
results  may  not  be  valid  and  conclusions  should  not  be 
drawn.  This  phase  consists  of  three  events.  First,  the 
subject  is  shown  what  terrain  output  looks  like.  Secondly, 
the  subject  is  shown  simple  symbols  and  their  Fourier 
transforms  on  a  plain  background.  Finally,  the  subject  is 
presented  the  symbols  overlayed  onto  the  terrain. 

Task  2,  the  non-stress  producing  identification,  shows 
a  simple  sequence  of  simple  objects,  their  Fourier 
transforms,  and  a  sequence  of  colors  to  the  subject.  The 
subject  views  the  symbol  and  indicates  what  he  thinks  it 
represents.  The  subject's  identification  is  either 


corrected  or  validated.  The  same  interaction  occurs  in 
color  identification. 

Task  3,  the  stress  producing  validation  segment,  is 
done  to  validate  that  the  symbols  really  do  represent  some 
identifiable  object  to  the  subject.  Symbols  are  presented 
in  a  random  order  and  the  subject  must  identify  it  and 
indicate  whether  or  not  the  object  is  a  threat. 

The  experiment  is  conducted  in  the  same  order  as  the 
video  product  described  above. 

Phase  1  corresponds  to  Task  1.  During  this  phase,  the 
subject  becomes  oriented  to  what  the  terrain  and  symbols 
should  look  like.  It  is  also  during  this  phase  that  the 
subject  and  the  one  conducting  the  experiment  develop  a 
rapport.  The  subject  must  feel  at  ease  during  the 
experiment,  and  this  phase  allows  this  to  happen. 

Phase  2  is  implemented  by  using  Task  2.  The  subject 
and  experimenter  interact  during  this  phase.  Phase  2  events 
occur  in  the  following  order:  First,  a  symbol  appears  on 
the  screen;  secondly  the  subject  indicates  what  he  thinks 
the  symbol  represents;  finally,  his  answer  is  either 
corrected  or  validated.  The  same  sequence  of  occurs  for 
color  identification. 

Finally,  Phase  3  is  conducted  using  output  from  Task  3- 
Symbols  are  generated  by  the  task.  As  soon  as  the  subject 
notices  the  symbol,  he  must  identify  it,  and  indicate 
whether  it  is  a  threat,  a  weapons  delivery  point,  or  neither 
of  these.  This  phase  is  used  to  validate  the  results  of 
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previous  phases. 

The  background  data  and  instructions  for  the  experiment 
are  presented  in  Appendix  E,  along  with  the  experiment 
questionaire ,  experiment  tally  sheet,  and  post-experiment 
questionaire . 
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The  AETMS  will  be  a  powerful  tool  once  a  few  logistics 
problems  are  overcome.  The  database  for  the  map  is  quite 
large  and  requires  a  great  deal  of  memory.  It  has  been 
suggested  that  bubble  memory  be  used  to  solve  the  space  and 
weight  problems  associated  with  other  memory  devices.  In 
addition,  bubble  memory  has  a  faster  access  time  than  other 
forms  of  memory. 

Furthermore,  additions  of  the  symbol  overlay  and  a 
threat  overlay  being  developed  by  the  University  of  Dayton, 
will  make  the  entire  package  a  versatile  tool  for  aircraft 


systems . 


VII. 


It  is  possible  to  task  SYMBOL  with  PRSPCT  and  the  data 
base  by  using  the  overlay  task  building  system  available  on 
the  PDP  11/45.  The  thesis  software  can  be  reduced  to  an 
overlay  of  itself.  There  are  at  least  two  ways  to  do  this 
One  way  is  to  overlay  every  subroutine  onto  the  main  body  of 
SYMBOL.  Another  way  to  do  it,  is  to  break  the  software  into 
logical  groups,  such  as:  SYMBOL  (  SYMBOL,  CHECK1 ,  CHECK2, 
CONVRT),  FLAG  (FLAG,  DRAW,  OFST,  BLOCK  DATA),  and 
PICTURE  (all  of  the  symbol  drawing  routines).  The  Fourier 
transforms  programs  need  to  have  one  more  module, 
FFT  (FOURT, SCALE, ZERO).  These  groups  can  then  be  overlayed 
onto  PRSPCT. 

It  becomes  hard  to  make  a  large  latitude  and  longitude 
table  for  symbols  since  memory  is  a  problem.  Therefore,  a 
more  compact  table  should  be  designed  to  alleviate  the 
problem.  One  way  to  do  this,  is  to  divide  BLOCK  DATA  into 
subsets  that  can  be  overlayed  onto  each  other.  There  would 
be  three  sections  of  block  data,  one  for  a  latitude  table,  a 
second  for  a  longitude  table,  and  a  third  for  a  flag  table. 

A  subroutine  needs  to  be  added  to  check  the  aircraft's 
altitude.  PRSPCT  monitors  altitude  and  so  this  parameter 
could  be  passed  to  SYMBOL.  Symbol  color  can  then  be  changed 
as  the  altitude  increases  or  decreases. 

The  symbol  set  must  be  tested  to  determine  which 
symbols  should  be  included  in  a  master  set.  More  symbols 
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need  to  be  added  to  the  current  table  so  that  testing  can  be 
conducted  to  determine  that  master  set. 

Finally,  the  entire  system  should  be  documented  so  that 
those  that  do  not  have  an  intimate  knowledge  of  the  system 
can  use  it. 
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APPENDIX  A 


FLOWCHARTS 

This  appendix  contains  the  flowcharts  for  SYMBOL  and 
its  sub-modules.  Note  the  difference  in  figure  10  and 
figure's  11  and  12.  Figure  10  represents  a  flow  chart  of 
data  that  has  not  been  transformed  to  Fourier  data. 
Figure's  11  and  12  represent  the  Fourier  transform  modules. 
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APPENDIX  B 


VARIABLE  A W  TABLE  D.EFINITIQ.NS 

This  appendix  contains  the  variable  and  table 
definitions  necessary  to  understand  their  use  in  SYMBOL  and 
PRSPCT.  Table  IV  describes  the  AETMS  defined  variables; 
Table  V  describes  variables  defined  in  SYMBOL;  and  Table  VI 
describes  the  tables  used  in  SYMBOL.  Common  areas  are 
described  in  Table  VII. 


TABLE  IV. 


NAME 

BAU 


DESCRIPTION 
^128 
1  BAU 

aircraft  azimuth 


j  Patch 


a  digital  description  of  a 
small  area  of  terrain  in  memory 


|  DH 


display  horizon  (5.52) 


DA 

D 


i 

I 


1 


IWY 

IWX 

IX 

IY 

JX 

JY 

KX 

KY 


change  in  azimuth  over 
one  time  slice 

aircraft  speed  in  knots 


Corner  coordinates  of 
the  window 
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TABLE  V 


NAME 

DESCRIPTION  ’ 

POSX 

POSY 

* 

Coordinate  conversion  factors 

CONS 

CONC 

sine  and  cosine  factors 

AX,  AY 

BX ,  BY 

CX ,  CY 
DPX.DPY 

Corner  coordinate's  (window) 

l 

X ;  YMIN 

X ; YMAX 

boundary  values  j 

SAB 

i 

1 

SBC 

SAD 

SDC 

Edge  (window)  slopes 

LCOUNT 

Number  of  symbols  in  the  window 

TABLE  VI. 

NAME 

DESCRIPTION 

RAMTAB 

Table  of  values  within  1 

the  bounds 

;  SYMTAB 

i 

Latitude  and  Longitude 
values  in  patch  coordinates 

TEMTAB 

Temporary  table 

i  POSTAB 

Latitude  and  Longitude 

values  in  real  world  coordinates 
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TABLE  VII. 


NAME  OWNERS 

DTABLE  BLOCK  DATA,  CONVRT 

DAREA  SYMBOL,  OFST 

DBLOCK  SYMBOL,  CHECK  1 , 

■  CHECK2,  CONVRT 


APPENDIX  C 
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1 

i 
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EQUATIONS 

This  appendix  contains  the  equations  necessary  to 


determine  the  conversion  factors  in  symbol.  All  of  these 
equations  were  developed  by  AETMS  designers  (Ref  15). 

IAY , FAY  =  ( IAY , FAY) +D( DA* ( B/2) *SINA+COSA) /DY 
IAX , F  AX  =  ( IAX , FAX) +D( SINA-DA*( B/2 ) *COSA) /DX 
POSX  =  D(SINA-DA*(B/2)*C0SA)/DX 
POSY  =  D(DA*(B/2)*SINA+C0SA)/DY 
CONS  =  ( (DH*SINA)/(2*DX) ) 

CONC  =  ( (DH*COSA)/ (2*DY) ) 


APPENDIX  D 


SYMBOL  S£1 

This  appendix  contains  the  eight  symbols  that  can  be 
displayed  by  the  thesis  software.  The  symbols  are 
international  symbols  compiled  by  Dreyfuss  (Ref  6). 
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APPENDIX  E 


EXPERIMENT  INSTRUCTIONS  AM  D-ATA  COLLECTION  FORMS 

This  appendix  contains  the  data  collection  forms 
necessary  to  compile  dataB  from  the  experiment.  Included  in 
this  appendix  are  the  background  and  instructions,  an 
experiment  questionaire,  an  experiment  tally  sheet,  and  post 
experiment  questionaire. 

Instructions  and  the  background  information  are  an 
important  part  of  any  experiment.  If  the  subject  is  not 
interested  in  the  experiment  in  which  he  will  participate, 
then  he  may  become  bored  or  inattentive.  Therefore,  the 
subject  is  first  given  some  background  information  about  the 
AETMS  and  why  the  experiment  is  to  be  conducted. 
Furthermore,  if  the  subject  does  not  understand  the 
instructions,  he  will  not  be  able  to  complete  his  task  and 
results  may  be  invalid  (Ref  3). 

INSTRUCTIONS 

This  is  a  three  part  experiment.  Part  1  is  an 
orientation  phase.  Part  2  is  an  identification  phase  and 
Part  3  is  a  validation  phase.  I  will  give  you  some 
background  on  the  AETMS  and  instructions  before  we  begin. 
Are  there  any  initial  questions? 

Part  V  is  an  orientation  phase.  You  will  be  shown  a 
sample  terrain,  symbols  on  a  plain  background,  and  symbols 
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overlayed  on  the  terrain.  Your  task  is  to  view  the  output 
so  that  you  will  have  an  idea  of  the  visual  output  that  will 
occur  in  the  other  two  phases.  Feel  free  to  ask  questions 
during  this  phase. 

TASK  1  is  presented  to  the  subject. 

Part  2  is  an  identification  phase.  We  will  interact  in 
a  question  and  answer  format.  You  will  be  presented  a 
symbol  on  the  screen.  Tell  me  what  you  think  it  is.  I  will 
validate  your  answer  if  you  are  correct,  and  correct  your 
answer  if  it  is  incorrect.  We  go  through  the  same  sequence 
of  events  with  different  color  combinations.  Are  there  any 
questions? 

TASK  2  is  presented  to  the  subject. 

Part  3  is  a  validation  phase.  Symbols  will  be  randomly 
presented.  Once  you  see  a  symbol  indicate  what  it  is.  Also 
indicate  whether  or  not  it  is  hostile  or  threatening.  This 
is  done  by  color  coding.  Colors  and  symbols  seen  in  this 
phase  are  the  same  as  seen  in  the  previous  phases. 

TASK  3  is  presented  to  the  subject. 

The  experiment  is  now  over.  Please  answer  the 
questions  on  the  questionaire. 

EXPERIMENT  QUESTIONAIRE 

1.  Task  2:  What  does  the  symbol  represent? 

2.  Task  2:  What  does  the  color  represent? 

3.  Any  task:  What  comments  do  you  have  about  this  phase? 
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V 


EXPERIMENT  TALLY  SHEET 


TASK  2 

OBJECT  PLACE  A  1  IF  THE  OBJECT/COLOR  WAS  CORRECTLY 
IDENTIFIED 


Highway 

Electrical  lines 
Bridge  a 
Bridge  b 
Pointer 
Target 

Landing  strip 
Building 


COLOR 


red 

green 

yellow 

black 

white 


TASK  3 

OBJECT  COLOR  COLOR/correct/SYMBOL  (1  indicates  correct) 


Building  green 
Target  red 
Pointer  red 

Electrical  lines  yellow 
Highway  green 
Landing  strip  green 
Electrical  lines  red 
Bridge  A  yellow 
Target  red 
Bridge  B  yellow 
Building  black 
Pointer  white 
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POST  EXPERIMENT  QUESTIONAIRE 


1.  Did  you  feel  at  ease  during  the  experiment?  If 
not,  why  not? 

2.  Were  there  too  many  distractions  during  the 
experiment? 


3.  Were  the  instructions  clear  and  was  there  ample 
time  to  ask  questions? 

4.  Rate  the  display  with  these  factors.  1  indicates  a 
high  rating,  5  indicates  a  low  rating. 

Legibility  12  3^5 

Understandibility  12345 

Functionality  12345 

Appeal  12345 

5.  If  you  were  in  the  position  of  accepting  this 
display  system  of  a  SPO  would  you 

a.  Accept  the  system  as  you  saw  it  in  the  experiment? 
Yes  No  (if  yes,  goto  6) 

b.  Require  a  change  to  the  terrain  output?  Yes  No 

c.  Require  a  change  to  the  symbols  in  the  symbol  set? 
Yes  No 

What  changes  would  you  expect? 

6.  Imagine  that  you  are  a  pilot  tasked  with  destroying 
an  enemy  oil  field.  Your  mission  will  take  place  at 
night  and  the  weather  leaves  much  to  be  desired.  You 
therefore  must  depend  on  the  display  system  in  your 
aircraft.  Will  you  feel  at  ease  in  trusting  your  life 
to  this  system? 

Why? 

7.  Please  feel  free  to  make  any  other  comments  about 
the  display  or  experiment. 
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APPENDIX  F 


USER  *  S  GUIDE 

This  appendix  contains  a  guide  for  those  who  would  like 
to  use  the  thesis  software. 

The  following  short  program  can  be  added  to  call  SYMBOL. 

Program  Runner 

Pr int* input  the  information  that  will  simulate  AETMS  inputs' 

Read* , I AY , IAX,FAY , FAX, A ,DX,DY , NX  f  NY , D ,DA 

Call  SYMBOL ( I AY, I AX, FAY, FAX, A, DX,DY, NX, NY, D, DA) 

END 

Figure  14  represents  BLOCK  DATA  as  it  is  in  the  thesis 
software.  The  first  21  entries  represent  IAX,FAX  and  the 
second  21  represent  IAY,FAY.  The  last  21  entries  represent 
flag  values.  The  following  equation  will  break  each  table 
entry  to  a  minutes  and  degrees  entry.  Input  into  RUNNER 
must  be  in  minutes  and  degrees. 

Let  the  entry  we  are  to  consider  be  the  first  one. 
IAX,FAX=  15.5  Break  down  is  done  in  the  following  manner: 

IAX=15  (integer);  FAX=.5*60  (real)  the  I AY  that  corresponds 
to  15.5  is  10.75.  Break  down  is  similar  to  the  IAX,FAX 
break  down.  IAY=10  (integer)  and  FAY=. 75*60  (real).  Input 
for  these  two  values  is:  I  AY  IAX  FAY  FAX  DX  DY  A  NX  NY  D  DA 
10  15  30.  30.  10.  10.  0.  64  64  0.  1. 

All  these  values  are  defined  in  APPENDIX  B.  A  and  DA 
must  be  input  as  BAU  values.  Conversion  from  degrees  to 
BAU's  is  done  with  the  following  equation: 

(azimuth  in  degrees) *( PI/ 128) 
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APPENDIX  G 


SOFTWARE  XISUHG 

This  appendix  contains  a  listing  of  all  the  modules  in 
SYMBOL  and  the  test  data.  Note  that  there  are  three 
subroutines  named  FLAG.  This  was  necessary  due  to  the  fact 
that  there  is  only  28K  of  usable  memory  in  the  PDP  11/45. 
The  program  could  not  be  compiled  as  one  unit.  Therefore, 
there  are  three  separate  tasks.  TASK  I  is  the  entire  module 
with  eight  symbol  drawing  routines.  TASK  II  uses  the  same 
SYMBOL,  CHECKI.CHECKII,  OFST,  and  CONVRT  that  TASK  I  uses. 
TASK  II  contains  subroutines  that  output  four  of  the  symbols 
as  Fourier  data,  while  TASK  III  outputs  the  other  four. 
FLAG  is  varied  depending  on  which  task  it  is  a  part  of. 

Also  contained  in  this  listing  of  the  executive  routine 
in  the  AETMS  system,  PRSPCT.  SYMBOL  is  called  by  PRSPCT 
just  before  the  end  of  the  controlling  loop. 
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I £51  RESULTS 


The  data  that  follows  is  the  result  of  input  to  the 
thesis  software.  The  input  is  data  that  is  simulated  to  be 
like  information  that  will  be  received  from  PRSPCT.  The 
output  statement,  DIRECTIVE  STATUS  1  and  IOSTAT  1  indicates 
that  the  Ramtek  driver  sucessfully  output  information  to  the 
video  display. 

The  first  nine  sets  of  data  show  that  all  symbols  can 
be  drawn.  The  second  set  of  data  shows  that  the  program 
does  not  fail  at  the  boundaries. 

The  corner  coordinates  are  the  coordinates  of  A,  B,  C, 
and  D  of  the  window.  X M I N ,  XMAX,  Y M I N ,  and  YMAX  show  the 
minimum  and  maximum  boundary  values.  The  other  data  is 
self-explanatory . 
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